EXPRESS MAIL NO. EL029404298US PATENT 

Attorney Docket No. 01-4008 



WHAT IS CIAIMED : 

1. A method for assessing a call center, said 
method comprising the steps of: 

gathering and studying information regarding a call 
flow of the call center's interactive voice response (IVR) 
systems- 
developing a coding sheet for the call center, the 
coding sheet summarizing a call to the call center, including 
interactions between a caller and the IVR system and 
interactions between the caller and a live agents- 
tabulating a plurality of calls to the call center 
on the coding sheet based on notes and/or recordings of 
entire calls, from beginning to ends- 
analyzing the tabulated coding sheet to determine 
areas of the IVR system that can be improved; and 

generating an analysis report itemizing the areas 
of the IVR system that can be improved and suggesting ways to 
improve those areas, 

wherein said tabulating step includes noting on the 
coding sheet, for each call, menu selections made by the 
caller in response to a prompt from the IVR system and a 
summary of interactions between the caller and a live agent. 

2. A method according to Claim 1, further 
comprising the step of summarizing the tabulated coding sheet 
to generate statistical data on the plurality of calls to the 
call center. 

3. A method according to Claim 1, wherein the 
analysis report generated in said generated step includes: 

noting whether a live agent performed functions 
that the IVR system can perform. 
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noting whether a live agent performed functions 
that the IVR system can be re-designed to perform, 

noting whether and how a call was transferred to 
more than one agent, 

noting at what point a call is terminated, and 

noting timing information for each call. 

4. A method according to Claim 1, wherein the 
analysis report generated in said generating step includes a 
suggestion to change a menu tree of the IVR system. 

5. A method according to Claim 1, wherein the 
analysis report generated in said generating step includes at 
least one of: 

a suggestion to re-word or re-phrase a prompt given 
by the IVR system, 

a suggestion to re-word or re-phrase a menu 
selection given by the IVR system, 

a suggestion to re-route a destination of a menu 
selection of the IVR system, 

a suggestion to enforce policies of the call 
center, in regard to action taken by an agent, 

a suggestion to re-engineer the IVR system to 
automate a function that is not currently available in the 
IVR system, and 

a suggestion to re-engineer the IVR system to 
provide a speech recognition option. 

6. A method for assessing a call center, said 
method comprising the steps of: 

developing a coding sheet for the call center, the 
coding sheet sxommarizing paths a caller may take during a 
call to the call center, including interactions between the 

93 



EXPRESS MAIL NO. EL029404298US PATENT 

Attorney Docket No. 01-4008 

caller and an automated IVR system and interactions between 
the caller and a live agent; 

tabulating on the coding sheet, for each call of a 
plurality of calls to the call center, events that occurred 
during the call; 

analyzing the tabulated coding sheet to determine 
areas of the IVR system that can be improved; and 

generating an analysis report suggesting ways to 
improve the areas determined in said analyzing step. 

7. A method according to Claim 6, wherein said 
tabulating step is performed from notes taken by an analyst 
during live calls, while the analyst is listening to the 
calls . 

8- A method according to Claim 6, wherein said 
tabulating step is performed from recordings of calls. 

9. A method according to Claim 6, wherein the 
analysis report generated in said generating step includes a 
suggestion to change a menu tree of the IVR system. 

10. A method according to Claim 6, wherein the 
analysis report generated in said generating step includes at 
least one of: 

a suggestion to re-word or re-phrase a prompt given 
by the IVR system, 

a suggestion to re-word or re-phrase a menu 
selection given by the IVR system, 

a suggestion to re-route a destination of a menu 
selection of the IVR system, 

a suggestion to enforce policies of the call 
center, in regard to action taken by an agent. 
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a suggestion to re-engineer the IVR system to 
automate a function that is not currently available in the 
IVR system, and 

a suggestion to re-engineer the IVR system to 
provide a speech recognition option. 

11. A method of assessing an automated call 
routing system's performance, the routing system being 
structured to present a caller calling into the automated 
call routing system with a call that includes an interactive 
voice response (IVR) portion and, at an option of the caller, 
an caller/agent dialog portion, said method comprising the 
steps of: 

monitoring calls coming into the automated call 
routing system; 

recording end-to-end calls from among the calls 
coming into the automated call routing system; 

transcribing a sequence of events for the recorded 
calls, including events occurring in the IVR portion and in 
the caller/agent dialog portion, to identify predetermined 
call events of interest; 

analyzing the transcribed calls to infer a complete 
event sequence of each of the recorded calls; and 

calculating parameters corresponding to cost 
effectiveness and usability of the automated call routing 
system, based at least in part upon information provided to 
the caller during the IVR portion. 

12. A method according to Claim 11, wherein the 
cost effectiveness parameter is measured in terms of agent 
seconds saved by a service or services capable of being 
performed in the IVR portion of a call actually being 
performed in the IVR portions of calls rather than in the 
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caller /agent portions of calls, agent seconds saved being 
defined as a difference between an amount of time it would 
normally take for an agent to provide a service to a caller 
in the caller/agent portion and an amount of time the service 
would have taken had the service been performed in the IVR 
portion. 

13. A method according to Claim 11, wherein said 
recording step occurs at a site remotely located from the 
automate call routing system. 

14. An apparatus operable to assess an automated 
call routing system's performance, the routing system being 
structured to present a caller calling into the automated 
call routing system with a call that includes an interactive 
voice response (IVR) portion and, at an option of the caller, 
a caller/agent dialog portion, said apparatus comprising: 

means for monitoring calls coming into the 

automated call routing systems- 
means for recording end-to-end calls from among the 

calls coming into the automated call routing systems- 
means for transcribing a sequence of events of each 

of the recorded calls, including events occurring in the IVR 

portion and in the caller/agent dialog portion, to identify 

predetermined call events of interest; 

means for analyzing the transcribed calls to infer 

a complete event sequence of each of the recorded calls; and 
means for calculating performance parameters 

corresponding to cost effectiveness and usability of the 

automated call routing system, based at least in part upon 

what, if any, information was obtained by the caller during 

the IVR portion. 
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15. An apparatus according to Claim 14, wherein 
the cost effectiveness parameter is measured in terms of 
agent seconds saved by a service or services capable of being 
performed in the IVR portion of a call actually being 
performed in the IVR portions of calls rather than in the 
caller /agent portions of calls, agent seconds saved being 
defined as a difference between an amount of time it would 
normally take for an agent to provide a service to a caller 
in the caller/agent portion and an amount of time the service 
would have taken had the service been performed in the IVR 
portion. 

16. An apparatus according to Claim 14, wherein 
said means for recording is located at a site remote from the 
automate call routing system. 

17. A system for assessing an automated call 
routing system's performance, the routing system being 
structured to present a caller calling into the automated 
call routing system with a call that includes an interactive 
voice response (IVR) portion and, at an option of the caller, 
an caller/agent dialog portion, said system being operable 
to: 

monitor calls coming into the automated call 
routing system; 

record end-to-end calls from among the calls coming 
into the automated call routing system; 

transcribe a sequence of events for the recorded 
calls, including events occurring in the IVR portion and in 
the caller /agent dialog portion, to identify predetermined 
call events of interest; 

analyze the transcribed calls to infer a complete 
event sequence of each of the recorded calls; and 
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calculate parameters corresponding to cost 
effectiveness and usability of the automated call routing 
system, based at least in part upon information obtained by 
the caller during the IVR portion. 

18. A system according to Claim 17, wherein the 
cost effectiveness parameter is measured in terms of agent 
seconds saved by a service or services capable of being 
performed in the IVR portion of a call actually being 
performed in the IVR portions of calls rather than in the 
J! caller /agent portions of calls, agent seconds saved being 

51 defined as a difference between an amount of time it would 

S: normally take for an agent to provide a service to a caller 

yl in the caller/agent portion and an amount of time the service 



would have taken had the service been performed in the IVR 
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19. A system according to Claim 17, wherein 
fI| recording of the end-to-end calls occurs at a site remotely 

^ located from the automate call routing system. 



20. A computer program product embodying a program 
for implementing a method for assessing an automated call 
routing system's performance, the routing system being 
structured to present a caller calling into the automated 
call routing system with a call that includes an interactive 
voice response (IVR) portion and, at an option of the caller, 
an caller /agent dialog portion, said computer program product 
comprising code for: 

monitoring calls coming into the automated call 
routing system; 

recording end-to-end calls from among the calls 
coming into the automated call routing system; 
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transcribing a sequence of events for the recorded 
calls, including events occurring in the IVR portion and in 
the caller/agent dialog portion, to identify predetermined 
call events of interests- 
analyzing the transcribed calls to infer a complete 
event sequence of each of the recorded calls; and 

calculating parameters corresponding to cost 
effectiveness and usability of the automated call routing 
system, based at least in part upon information obtained by 
the caller during the IVR portion. 

21. A computer program product according to Claim 
20, wherein the cost effectiveness parameter is measured in 
terms of agent seconds saved by a service or services capable 
of being performed in the IVR portion of a call actually 
being performed in the IVR portions of calls rather than in 
the caller /agent portions of calls, agent seconds saved being 
defined as a difference between an amount of time it would 
normally take for an agent to provide a service to a caller 
in the caller/agent portion and an amount of time the service 
would have taken had the service been performed in the IVR 
portion. 

22 . A computer program product according to Claim 
20, wherein recording of the end-to-end calls occurs at a 
site remotely located from the automate call routing system. 
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